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O.  Abstract  Let  K denote  an  arbitrary  compact  subset  of  L2. 
Let  f be  any  causal  continuous  function  on  L2.  Then  there  is  a 
linear  differential  system:  x(t)  = A(t)x(t)  + B(t)u(t),  and  a 
memory  less  polynomic  state  to  output  map  y (t)  =<J>  (x  (t)  ) such  that 
the  system,  f,  thereby  computed  satisfies 

sup  | | f (u)  - f (u)  | | < e 
x £ K 

where  e> 0 is  arbitrary.  This  and  other  results  are  developed. 


1.  Introduction.  This  article  deals  with  the  approximation 
of  nonlinear  systems  by  polynomic  operators.  For  perspective 
it  is  helpful  to  consider  the  familiar  Volterra  series 
expansion  on  L ^ given  by 

p(x)  = kQ  + J*k1(a)x(a)da  + j Jk2  (a , 3)  x(ot)x(B)  dotdB  + 

| | jk3(ct,3,Y)x(a)x(B)x(Y)dad3dY  + ...  (1) 


where  the  kernels  kg,k^,...,kn  satisfy  properties  suitable  to 
an  operator  on  I^.  For  the  obvious  reasons  we  refer  to  each 
term  on  the  right  hand  side  as  a power  function.  If  the 
number  of  terms  is  finite  then  p is  said  to  be  a polynomic 
operator.  Our  interest  in  polynomic  operators  centers  on 
their  use  as  approximates  of  the  more  general  nonlinear 
functions  on  L.. 
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The  relevant  literature  may  be  grouped  into  two 

m subcategories.  First  there  is  the  analytic  theory  in  which 

■F 

£ is  assumed  to  have  derivatives  (Frechet  or  Gateau)  of 
all  orders  and  p arises  as  a power  series  expansion  on  a 
bounded  domain.  This  line  of  development  was  initiated  by 
Volterra  [1]  and  was  first  applied  in  a systems  setting  by 
Weiner  and  in  ensuing  years  several  others  including  [2] , 

[3],  and  [4].  More  recently  [5],  [6],  [7],  [8]  have  investigated 

the  Volterra  expansion  of  solutions  to  nonlinear  differential 

equations  with  current  emphasis  on  computation  and  convergence 
problems. 

The  analytic  theory  identifies  the  power  functions 

with  the  derivatives  of  the  system  function,  f,  to  be 

approximated.  The  requisite  differentiability  is  a severe 

\ condition,  however,  a fringe  benefit  accrued  is  that  the 

causality  of  the  power  functions  is  dictated  by  the  causality 

of  f.  . . 

In  an  independent  line  of  development  the  polynomic 

approximation  problem  has  been  approached  as  a generalization 

of  the  classic  Weierstrass  result.  In  this  setting  the 

function,  f,  to  be  approximated  need  not  be  differentiable. 

Emphasis  is  placed  on  uniformly  approximating  f,  by  the 

polynomial  p,  over  an  arbitrary  compact  set.  In  this  approach 

t the  causality  issue  is  less  trival.  The  computation  of  the 

power  functions,  which  no  longer  represent  derivatives,  has 

here  to  fore  been  obsure.  In  sections  (3)  and  (4)  we  develop 

the  concept  of  a Bernstein  differential  system.  This  system  provides 

one  constructive  realization  of  the  Weierstrass  approach.  In  section  (5)  we 
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compare  in  part  the  properties  of  the  analytic  theory,  the 
Weierstrass  based  theory  and  in  particular  the  Bernstein  system 
realization  of  section  (4). 

An  incidental  bonus  of  the  Bernstein  system  is  a 
pseudo  sampling  theorem  for  systems.  In  short,  given  an 
arbitrary  system  with  a prescribed  continuity  modulus,  the 
density  with  which  one  must  input-output  sample  in  order  to 
be  able  to  approximately  reconstruct  the  system  is  established. 

For  efficiency  of  presentation  we  shall  in  many  cases  be 
overly  restrictive  in  the  assumptions  made,  for  example  we 
consider  only  Hilbert  spaces.  Also  in  sections  (3)  and  (4) 
the  development  is  purposely  constrained  so  as  to  use  classical 
results  on  the  Bernstein  polynomials. 

In  closing  this  introduction  it  is  noted  that  the 
admittance  characteristic  of  the  enhancement  mode  MOSFET 
transistor  provides  an  almost  exact  square  law  (see  [9]). 

It  is  easily  shown  that  squaring  devices  can  be  used  to 
construct  general  polynomic  operators  of  the  type  necessary 
to  realize  the  Bernstein  system.  Thus  it  appears  that  the 
topic  of  polynomic  system  approximation  may.  have  a ready 
practicality  in  terms  of  microcircuit  technology. 

2.  Weierstrass  Approximation.  As  the  technical  work  of  this 
study  deals  primarily  with  the  Weierstrass  approximation  it 
is  useful  to  comment  in  somewhat  more  detail  on  the  existing 
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literature.  In  this  regard  we  cite  first  the  original 
contribution  of  Weierstrass  [10]  whose  fundamental  result 
in  contemporary  form  reads  as  follows. 

Let  f be  an  arbitrary  continuous  function  on  R,  the 
real  line.  Let  D c R be  an  arbitrary  compact  set.  Then 
for  every  e > 0 there  exists  a finite  polynomial  p,  such  that 
sup{|f(x)  - p(x) | : xeD}  < e.  The  Weierstrass  result,  over 
the  years,  has  drawn  the  attention  of  several  distinguished 
mathematicians  including  Frechet  [11],  Bernstein  [12]  and 
Stone  [13]  who  investigated  the  relationship  to  power  series 
expansions,  constructive  methods  for  finding  the  polynomial 
and  extended  the  result  to  Rn  among  other  things. 

More  recently  Prenter  [14]  considered  a real  separable 
Hilbert  space  H,  and  showed  that  if  K c H is  compact,  e > 0 
and  f continuous  on  H then  there  exists  a finite  polynomic 
operator  p,  such  that 

Slip  | | f(x)  - p(x)  | | < e.  (2) 

xcK 

In  a similar  effort  Prenter  [15]  and  Ahmed  [16]  were  able 
to  use  normed  linear  spaces. 

The  Prenter  result  [14],  for  example,  states  that  if  f 
is  a continuous  function  on  real  L2(a,b)  then  on  every  compact 
subset  there  exists  a finite  number  of  kernels  kQ,kj,...,kn 
such  that  p of  equation  1 is  an  e -approximat ion  for  f. 

Actually  we  would  suspect  more,  namely,  that  if  f is  causal 
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then  each  kernel  k^  is  causal,  that  is  for  instance 
kjCt.r)  = 0,  x > t.  More  generally,  can  a causality 
structure  be  superimposed  on  the  function  and  its 
approximation?  This  question  is  answered  affirmatively  in 
[17]  and  [18]. 


The  setting  for  [17]  and  [18]  is  a Hilbert 
resolution  space*  {H.P^  where  H is  real  and  separable.  The 
set  K c H is  always  compact.  The  sets:  C,  SC,  M,  C(K) , and  P 
denote  the  causal,  strictly  causal,  memoryless,  continuous 
on  K c H,  and  polynomic  functions,  respectively,  on  {H.P^}. 
For  brevity  we  shall  say  that  P is  dense  in  CCK)  in  the 
sense  of  Prenter's  theorem. 

The  results  of  [17]  include  the  following.  The  set 
P n SC  is  dense  in  C(K)  n SC.  In  L 2 the  stronger  result  that 
P n SC  is  dense  in  C(K)  fl  C is  also  established.  This  last 
result  does  not  abstract.  In  £ ^ it  is  known  [18]  that  P n SC 
is  not  dense  in  C(K)  n C. 

All  of  the  above  results  are  nonconstructive  in  that 


1 A formal  definition  is  given  later. 
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they  give  no  clue  as  to  finding  the  polynomic  approximate 
of  a given  function.  On  the  real  line,  however,  several 
constructive  forms  of  the  Weierstrass  result  do  exist  and 
the  Bernstein  polynomials  constitute  one  of  the  more 
intriguing  approaches  to  such  constructions.  In  section  (3) 
we  develop  a generalization  of  the  Bernstein  polynomials  to 
real  Hilbert  space.  Using  a causal  data  interpolation  scheme 
identification  of  the  p e PflSC  that  approximates  f e C(K)nC 
results . 

In  section  (4)  we  consider  the  realization  of  the  operator 
p in  state  variable  form.  This  objective  is  also  achieved  as 
is  evidenced  by  the  following  theorem  of  section  (4) . 

Theorem.  For  every  f e C(K)  n C and  c > 0 , there  exists  a 
differential  system 

z(t)  = A(t)z(t)  + B (t) u (t)  , z (0)  = 0, 

w (t ) = <f>(z(t)  ,t) 

where  ♦((•), t)  is  polynomic,  such  that  the  map  w = p(u) 
satisfies 

sup | | f (u)  - p(u) | | < e. 

K 

For  obvious  reasons  the  equations  of  this  theorem  are  called 
a Bernstein  system. 

3.  The  Bernstein  Polynomials.  We  shall  make  use  of  a 
classical  result  on  the  Bernstein  polynomials.  It  is  helpful 
to  introduce  this  result  and  associated  notation  before 
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proceeding.  First  we  define  the  functions  pn(v:(*))  on  [0,1] 
by  the  expression 


pn(v:x)  = (")xV(1-x)n'v,  xe  [0,1]  (3) 

where  ve (0 ,1 , . . . ,n} . 

Now  let  f be  a bounded  function  on  [0,1].  The  polynomial 

A 

fn(x)  is  defined  by  the  equation 
i n 

. - fn(x)  = l f (v/n)pn(v  :x)  , xe  [0,1]. 

v = 0 

A 

The  familar  result  of  Bernstein  is  that  fR(x)  -*■  f(x)  at 
every  point  of  continuity  of  f.  Moreover,  if  f is  continuous 

A 

on  [0,1],  then  f -*•  f uniformly.  While  we  shall  not  dwell 
on  the  proof  of  this  result  it  is  noted-that  positivity 
of  pn(v:x)  on  [0,1]  was  used  by  Bernstein  in  an  essential  way. 

Consider  then  ft  = [0 , 1 ] m c Rm  and  let  f be  a function  on 
Rm  which  is  bounded  on  ft.  Let  x = (x^,...,xm)  e ft  and  define 
the  polynomic  function 


fn^xl Xm^ 


-in  n J 

l ••  l * 

vr°  v° 


V,,  v | 

n * *n  J^nv  1 1^’  ’*n^  m m7 


C4) 


Using  the  single  variate  proof  as  a model  it  is  easily  shown 

i rt 

* A > 

that  fn  -*•  f pointwise  at  all  points  of  continuity  of  f 
and  uniformly  over  ft  if  f is  continuous  on  ft. 
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The  farther  extension  that  is  needed  in 
the  present  study  is  a relatively  mild  one.  For  this  let 
H be  any  real  Hilbert  space  and  {e^,...,em}  any  finite  set. 

We  then  form 

m 

« = (z  = l x . e . : 0<x. <1}  (5) 

i=l  11  ~ 1— 

Ak 

and  define  the  polynomic  function  f by  the  equality  (4) . 

The  proof  for  H=Rm  and  ft  = [0,l]m  uses  neither  the  linear 

independence  nor  the  orthonormality  of  the  coordinate  basis 

of  Rm.  As  such  the  result;  that  | | f^Cx)  - f (x)  | | -*■  0 at  all 

points  of  continuity  of  f and  uniformily  over  ft  if  f is 

continuous  on  ft,  follows  by  inspection. 

To  summarize  the  present  adaptation  of  existing  results 

to  Hilbert  spaces  it  is  convenient  to  simplify  notation.  First 

let  {e^,...,em>  be  linearly  independent  and  let  {e^,...,e*}  be 

the  associated  dual  set;  that  is  linear  span{e^ , . . . ,em>  = 

linear  span{e*  , . . . ,e  + } and  <et,e.>  = 6 i,j  = l,...,m.  Let 

J.  m i J ij 

n - (n1,n2, . . . ,nm)  and  v = (v2 ,v2 vffl)  be  two  integer 

tuplets.  We  shall  use  n -*•  °°  to  denote  the  condition  that 
all  n^  ■+■  although  not  necessarily  at  the  same  rate. 

Using  equation  (3)  we  define 

m + 

p(v:x)  = n p (v-:<e.,x>).  (f6 ) 

i=l  ni  1 1 

We  note  that  p is  a scalar  valued  polynomic  map  defined  on  H. 
Using  the  notations 


l I • • • 1 

v=0  v. =0  v_=0 

1 m 
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and 

jn 

f(v/n)  = f£  l (v./n.)e.)  .(7) 

i=l  1 1 1 

A 

we  define  the  polynomic  function  f on  H by  the  expression 

n 

fn(x)  = I f(v/n)p(v:x) , x e H.  (8) 

- v = 0 

The  result  which  can  be  gleaned  from  the  classical 
theory  is  the  following 

Theorem  (1) . If  f is  bounded  on  ft  then  for  each  x e ft,  and 

A 

e > 0 there  is  a finite  tuplet  n such  that  | |f(x)  - fn(x) | | < e 
at  every  continuity  point  of  f.  If  f is  continuous  on  ft  then 

A 

| | f n (x ) - f (x)  ||  -*■  0 as  n ■*  » uniformly  over  ft. 

Remark.  In  the  above  theorem  ft  is  given  by  equation  (5).  For 
the  more  general  situation 

m 

ft  = { I.o.e.  : 0<a.<M. } , 
i-1  1 1 

a simple  change  of  variables  f (v/n)  = f I (v./n^M.eJ 

li=l  ) 

preserves  the  validity  of  the  theorem.  If  K is  an  arbritrary 

compact  set  then  one  can  show  that  an  affine  map,x,  exists  such 

that  t (K)nft/<j>.  Moreover  x has  an  affine  left  inverse,  x+. 

Letting  g=fx+  we  construct  6 to  fit  g on  ft  and  then  show  that  f 

n ^ n 

A 

gnx  fits  f on  K.  These  manipulations  are  straight  forward  but 
cluttersome  and  are  omitted  to  save  space. 
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Causality  Structure.  We  now  augment  our  real  valued  Hilbert 
space  with  a resolution  of  the  identity.  The  resultant 
Hilbert  resolution  space  has  proved  to  be  a natural  setting 
for  the  study  of  system  theoretic  problems  (see  [17],  [20], 

[21],  [22]). 

Let  v denote  an  ordered  set  with  minimal  and  maximal 

elements  to  t respectively.  The  weakly  closed  set  of  orthoprojectors 

> 

{Ptrtev}  is  a resolution  of  the  identity  provided  P 0 = 0, 

4-  t-  ft  1"  R 

P 00  = I and  P Pp  whenever  t _>  B . Here  P >_  Pp  denotes  the 
condition  PtP^  = P^P1  = P^.  We  use  also  the  notation  Pt  = I-P1 
tev  and  A(t,B)  = P1-?6  = P1^  = P^P1.  Note  that  A(t,6)  is 
an  orthoprojector  and  that  A(t,B)  = 0 all  B^t. 

Consider  now  a function  f on  H with  f(0)=0.  Following 
[17],  [21],  [22]  we  say  that  f is  causal  if  and  only  if 

ptf  = ptfpt,  all  t e v. ’ (9) 

Now  let  {tQ  ,t1 , . . . »tN_1,too)  be  an  ordered  finite  subset  of  v. 

For  convenience  set  P-1  = P*j  and  A(j)  = A(j,j-1)  = Pj  _^P  • Using 

equation  r 9 1 it  follows  easily  that  A(j)f  = ACjjfP-5  holds 
v 1 N 

for  causal  f.  Since  \ A(j)  = I it  follows  that 

j-1 

N- 

f = l A ( j ) f P^ 

3 = 1 

and  taking  the  limit  as  the  mesh  {tQ tN-l,t°°^  is  refined 

one  arrives  at  a natural  integral  representation, 

f = jdP(s)fPs 
v 


rr 
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for  f.  This  abbreviated  discussion  is  expanded  on  in  the 
references  cited.  We  use  it  here  for  motivational  purposes. 

Our  attention  now  returns  to  the  earlier  Bernstein  problem 
with  H being  a Hilbert  resolution  space.  The  set  (e^,...,e  } is 
said  to  be  well  posed  provided  (P^e^:  i=l,...,m}  is  linearly 

independent  for  every  t > to.  For  convenience  we  assume 
that  (e^,...,e  } is  well  posed.  We  note  that  if 

m 

fi  = { Ja.e.  : 0<a.£l} 
i = lx  1 

1"  ^ f- 

fl  = { JB.P  e.  : 0<B . <1} 

i=l 1 1 1 

then  = P*  (Q)  . It  is  also  obvious  that  when  {e.,..,,e  } 

is  well  posed  then  {et,...,e+}  is  well  posed  and  the  set 

l m 

{ (Pte-j  ) + , . . . , (Ptem)  + } is  well  defined  for  all  t > to- 
Using  equation  (3)  we  make  the  extended  definition 

m t + 

p(v:x;t)  = n p (v . : < (P  e. ) ,x>) , all  x e H,  (10) 
i=l  ni  1 1 

* 

where  t„  4 tev • It  can  be  easily  shown  that  p is  continuous 
in  t,  and,  of  course,  polynomic  in  x,  moreover 

ptx  = 0 =>  p(v:x;3)  = 0,  all  B < t,  (11) 

Recall  now  that  f (v/n) , of  equation  (7),  for  each  v/n,  is 
an  element  of  H.  Choosing  now  a partition  for  v we  form 


This  property  assumes  that  {P^}  is  continuous  in  the  sense 

that  lim||PtPt.  x||  = 0 all  tcv. 
e-»0  c'e 
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N 

£ A(j)f(v/n)p(v:x;t.).  (12) 

j=l  J 

We  now  take  the  limit  over  partition  refinement 


N 

/dP(s) f (v/n)p(v: x;s)  = lim  £ & ( j ) f (v/n) p (v : x ; t . ) 

N+®  j=l  J 

where  the  limit  converges  by  a result  of  Masani  [23]. 

. Since  the  set  v <_•  n is  finite  we  may  sum  the  above  function 

without  disturbing  the  convergence.  This  results  in  the 
definition 


n 


f!j(x)  = I dP(s)f (v/n)p(v  :x;s). 

5.  v=  oJ  “ “ ~ 

c 

We  note  first  that  fn  is  causal,  indeed 

- t 

pV(x)  = l f dP(s)f(v/n)p(v:x;s) 
- V = 0J  t0 


(13) 


however 


p (v  : x ; s)  = p^rP^Js)  s < t 

and  hence  Ptfc  = PtfcPt , t > t0  Suppose  now  that  f is 
n n 

causal . Thus  in  equation  (12) 


A(j)f(y/n)  = Pj.jP^v/n) 

= A(j)(fP^)  (v/n) 

m - 

- A(j)f(Ji(vi/ni)PJei), 

therefore 

n 

A(j)f^(x)  = A ( j ) { l (fPJ)  (v/n)p(v:P’ix;t,)  } 

- v=0  J 
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The  bracketed  quantity,  however,  is  the  Bernstein  approximate 
for  A(j)fP^  thus 

N N 

E A(j)fJ|  - I A ( j ) f 
3=1  “ j=l 

with  convergence  in  the  spirit  of  theorem  (1) • 

We  summarize  our  development  in  the  following  theorem 

Theorem  (2) . If  causal  f is  bounded  on  ft  then  for  each  xeft, 

and  e>0  there  exists  n such  that  ||f(x)  - f^(x) | | < e 

at  every  continuity  point  of  f.  If  f is  continuous  on  ft  then 

n exists  such  that  sup||f(x)  - fC(x)||  < c. 

xeft  - 

4.  Realization.  The  explicit  nature  of  equation  (13)  and 
theorem  (2)  have  answered  the  central  theoretical 
questions  in  rather  complete  form.  It  is  of  interest,  however, 
to  give  a realization  of  the  causal  Bernstein  function,  f , in 
state  variable  form.  For  this  we  shall  focus  attention  on 
the  real  L^tO.d].  for  0<d<°°  equipped  with  the  usual  inner 
product  and  take  the  resolution  of  the  identity  to  the  familiar 
truncation  operators 

fx(B)  0 < t 
(Ptx)(B)  = / 

I 0-  B > t 


In  this  last  expression  and  elsewhere  we  slur  over  the  distinction 
between  functions  and  equivalence  classes  of  functions  as  is 
the  convention  in  dealing  with  the  Lebesquc  spaces. 
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Consider  first  the  set  {P^e  : i=l,...,m}  which  is  well 

i 

posed.  In  earlier  studies,  [19 ] , [ 2 0 ] » the  computation  of 
the  parameterized  dual  set  {(P^e^)*}  has  been  explored  in 
some  detail.  The  pertinent  results  are  summarized  in  the 
following  development.  Following  the  earlier  work  define  now 
the  m x m symmetric  matricies  N(t),  X(t) , n(t),  A(t)  by 
the  equalities  (here  t e (0,°°)) 

N.jCt)  « <Ptei,ej>|  |Ptei|  I'1!  |Ptej|  f1 

Xi;j(t)  = e?(t)||Ptei|  |'26ij 

ni;j(t)  = ei(t)ej(t)||Pteiir1||Ptejir1 

- npSir^ij 

where  X(t) , A(t)  are  diagonal  as  indicated  by  the  Kronecker 
term  6.^  . 

Note  that  N(t)  is  the  Grammian  matrix  of  a linearly 
independant  set  namely  {Ptei/ || Ptei | | } and  as  such  is 
invertable  for  all  t > 0.  It  is  shown  in  the  references  cited 
that  K(t)  = N(t)  1 satisfies  the  Riccati  equation 

fc(t)  = l/2{X(t)K(t)  + K(t)X(t) } - K(t)n(t)K(t)  . (14) 

The  equality  K(t')  = N(t’)  ^ provides  an  initialization  on 
this  last  equation  for  any  t'  > 0.  In  particular  since 

limN(t)  = Grammiante , / | | e . | | } it  may  prove  convenient  to  solve 

t-*-t  1 1 

00 

equation  (14)  in  reverse  time. 
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For  convenience  we  let 

" « r • j ^ v '«•  ' 


et  = column(Pte1, 

-I 

e*  = column ( (Pte1) ^ (Ptem)  ) 


A result  of  [20]  is  that 

e*  = A(t)K(t)A(t]e  t , t > 0 J (15) 

which  is  an  explicit  formula  for  £t.  From  equations  (10)  , (13) 
we  see  that  <(Pte^)+,x>  is  a key  ingredient.  Using  (15) 
it  can  be  easily  seen  that  these  functions  are  computed 
in  vector  form  by  the  expression 


where 


^(x.t)  = f A (t) K(t) A(t)e (s)x(s) ds 

Jo 


(16) 


e(s)  = column(e1(s)  . ,em(s)) 

'F(x.t)  = column(<  (Pte1)  + ,x> < (Ptem)  + fx>)  . 


We  are  now  in  position  to  state  the  relevant  result 
of  [20]. 

\ 

\\  Theorem  ( 3)  . The  equality  z(t)  = 'Kx.t)  holds  if  and  only  if 
4 X 

p(t)  = -l/2X(t)p(t)  + A(t)e(t)x(t) , t e (0  ,°°) 

P(0)  « 0 

z(t)  = A ( t ) K ( t ) p (t)  , t e (O.co). 


It  is  noted  that  this  theorem  provides  an  explicit  state 
variable  realization  of  the  requisite  map,  x -*■  V. 
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In  stating  our  final  result  it  is  helpful  to  utilize 
the  change  of  variables  z(t)  =/V  (t)  K ( t ) p (t ) and  the  identity 
A - ( - 1/2) XA  which  results  in  the  corollary 

Corollary.  The  equality  z(t)  = 'J'Cx , t)  holds  if  and  only 

if 

'z(t)  = -A  ( t ) K (t  ft  (t)  A-1  (t)  z (t)  + A ( t)  K (t)  A(t)e(t)x(t)  , t*0 

z(0)  = 0.  (17) 


We  turn  now  to  the  computation  of  the  resolvent  integral 
of  equation  (13).  Consider  first  a fixed  y e L2(0,«>)  and  a 
bounded  continuous  scalar  valued  function  m(*).  Using  the 
notation  Afj)  of  section  (3)  we  have 


A(j)ym(j) 


m(tj)y(e) 


t . 
J 


otherwise 


thus 


m(t)y(t) 


t = t. 


limA(j)ym(j)  = 

iVb-i1  * 0 


Clearly  then  on  l^,  z = jdP(s)ym(s) 

z(t)  = m(t)y(t) 


otherwise, 
if  and  only  if 

t e (0 ,°°) . 


For  convenience  let  yv  = f (v/n) . Recall  also  the  scalar 
valued  functions,  p(v:r)  on  [0,l]m 
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p(v:r)  = rm)  c [O.ll” 

We  construct  the  map  <J>:  (0,l]m  ->■  l2  by 

n 

4>Cr:t)  = l y (t)p(v:r),  r e [0,l]m 
v=0  - 

The  above  development  has  culminated  in  the  theorem. 

Theorem  ( 4)  . cu  = f^(x)  if  and  only  if 

z(t)  = -A(t)  K(t)  II  (t)  A~*  (t)z(t)  + A(t)K(t)A(t)e(t)x(t)  , t>0 

2(0)  = 0, 
w(t)  = 4>(z(t):t). 

Example . In  this  example  we  let  H = L2(0,1)  and  consider 
the  power  functions 

Xj(t)  = (l/j)t^  j=  1,...,  te  [0 ,1] . 

It  is  readily  verified  that  the  set  (P^. : j=  1,...}  is 
linearly  independent  for  any  t e CO , 1 ] and  that 

iip^-m2  = t2j+yj2(2j+i),  j=  i,...  . ci8) 

In  particular  | | Xj  | | /zjtt. 

Now  let  T be  given  by  the  defining  equality 

00 

r - {x=  l a .x . : | a . |<M} 

j=l  J J J 
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where  0<M<<».  Using  standard  techniques  it  is  not  difficult  to 
verify  the  following  facts  about  T.  First  T is  compact  and 
second 

||?  a x.  | | </2M //* 

j = *.+l  3 3 

For  any  e>0  we  choose  £(e)>  8Mz/e2  in  which  case 

1(e) 

“e  = { x:  Jiajxj:  lajl  - M} 

contains  an  e/2  cover  for  T.  Using  continuity  arguements 
we  construct  approximations  on 

The  set  (PfcXj  : j=l,..  ,£}  is  linearily  independant  for 
all  t>0  and  hence  the  tools  of  theorem  4 apply.  For  convenience 
let  us  assume  0<a^<l  and  make  the  choice  e.=x.  j=l,..,£. 

We  move  then  to  theorem  (3)  and  its  corollary.  Using 
the  defining  equality  it  is  easily  seen  that  N is  constant, 
a property  which  was  explored  in  detail  in  [19] , and  that  all 
quantities  of  equation  (17)  can  be  explicity  determined.  In 
fact, 

N±j  = /(2i+iy(2j  + l)/(i+j  + l) 

Xi:J  ' (2j+l)  6±j/t 

ntj(t)  = /(2i+l)  (2j+l)/t 

e(t)  = col(t 

It  is  important  to  note  that  the  state  vector  of  equation  17 
is  of  dimension  l.  This  dimension  is  fixed  from  this  point 
forward  and  does  not  vary  with  n as  the  f^  approximations  are 
constructed.  Of  course  as  e is  reduced  £(c)  increases. 


.4 
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To  carry  forward  in  a very  explicit  manner  let  us 


assume  1=2 . Then 


K= 

16 

-4/15  j 

i# 

• i 

X=t_1 

3 

0 

9 

n=t_1 

3 

/I5~ 

-4/15“ 

w 

r 

16 

0 

L 

5 

mtt 

/T5 

5 

Using  equation  18  it  is  clear  that  A(t)  and  hence  the  matricies 
of  equation  17  are  readily  and  explicitly  determinable.  Our 
attention  turns  to  the  construction  of  the  polynomic  state 
output  map  of  theorem  4. 

Our  function  set  is  of  the  form  x(t)=at  + $t2  with 
(Ka,  B£l  and  we  consider  the  function 
[f  (X)  ] Ct)  = X(t)  + |x  ( t )| 
for  y = f (x)  it  follows  that 

y (t)  = 48 2 + at  + Bt2  (19) 

Let  us  choose  n = (2,2)  in  which  case  v can  take  on  nine  values 
< n.  Using  the  previous  notation  the  following  table  is 
readily  constructed 

TABLE  1 


w/n 

f (v/n)  (t) 

Pn,,ul!  zl<t)0 

Pn(v2:  z2(t>> 

p(v  i z(t)) 

(0,0) 

0 

ri-z2(t)j2 

, Il-z2(t))2 

[l-z1(t))2[l-z2(t)]2 

(0..5) 

l*.5t2 

[l-Zjft)]2 

2z2(t) [l-z2(t) ) 

2(l-z1(t))2z2(t) [l-z2(t)J 

<0,1) 

4*t2 

U-Zj(t))2 

zMt) 

Il-z1(t)]2z|(t) 

(.5,0) 

• 5t 

2z^  (t) (l-z1(t)) 

Il-z2(t) ]2 

2z1(t) Il-z1(t))[l-z2(t))2 

(.5. .5) 

l+.5t+.5t2 

2zx(t) [l-z1(t)l 

2z2(t) [l-z2(t)l 

<*1(t)z2(t) [l-z1(t) ) (l-z2(t) ] 

(.5.1) 

<♦. 5t+t2 

2z1(t) [l-z1(t)J 

z|(t) 

2*2(1)  Il-z1(t))z|(t) 

(1,0) 

t 

**  (t) 

(l-z2(t))2 

*J(t)  [l-z2(t)]2 

(1, . 5) 

l+t+.5t2 

*J(t) 

2*2 (t) (l-z2(t)J 

2*2  (t)  *2  (t)  (l-*2(t)  J 

(1.1) 

«+t+t2 

*J(t) 

**(t) 

a 

*|(t)*  (t) 

The  function  $(z(t);t)  is  formed  by  taking  the  dot 
product  of  the  f (v/n)  (t)  and  p(v:  z (t) ) columns  of  table  1. 
The  resultant  expression  does  not  add  any  additional  clarity 


r 


20 


so  we  will  forego  this  here.  To  illustrate,  however,  we  note 
that  when  a=0,  O_<0_<1  then  z^(t)=0  and  Z2(t)=0.  The  above 
dot  product  produces 

<Mz(t),t)  = (1  + .5t2)  (2)  (0)  (1-6)  + (4  + t2)  02 
= 26(1  +6)  + 0t2 
The  systen,  f,  produces 
f(x)  = 402  + 0t2 

Similarly  with  0<a<l  and  0=0  it  can  be  verified  easily  that 
(fx)  (t)  = 4>(z(t),t)  = at. 

5 _. Remarks  and  Conclusions.  The  example  of  the  last  section 

demonstrates  several  properties  which  are  not  explicit  in 

theorem  4.  We  have  already  noted  that  the  size  of  the  state 

space  does  not  change  with  n.  We  see  also  that  the  output 

constraint  map  <p  is  a memoryless  function  of  the  state.  Finally 

it  is  clear  from  table  1 that  <p  can  be  related  to  a bilinear 

form.  In  short  we  let  z=(l,z^,z^,  zj^z^)  in  which  case  there 

exist  a matrix  E(t)  such  that 

<(>(z  (t)  , t)  = z*(t)E(t)z(t)  t>0 

The  matrix  E being  taken  from  table  1 in  the  obvious  way.  This 

form  is  also  valid  in  the  general  case. 

It  was  noted  in  the  introduction  that  our  results  have 

the  characteristics  of  a sampling  theorem  for  systems.  The 

development  does  not  emphasis  this,  however,  in  these  results 
c 

one  can  see  f as  a reconstruction  of  f from  the  samples 


(f(v/n)  : v=0,l, . . . ,n} . 
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It  should  be  noted  that  given  a set  of  input-output 
pairs  it  is  possible,  by  easier  means  (see  [19]), 

to  construct  a causal  polynomic  map  p,  such  that  p(x^)=y^ 
i=l,...,n.  The  polynomic  construction  of  [19]  however  will  not 
necessarily  uniformly  approximate  the  continuous  function 
generating  the  original  data.  In  the  same  spirit  the  Bernstein 
system  of  section  (4),  while  it  approximates  the  function,  does 
not  reproduce  exactly  the  original  input-output  measurements. 

(It  comes  e close,  of  course.) 

In  section  (2)  it  was  pointed  out  that  the  results  of 
[14,  15,  16,  17]  use  a separability  assumption  on  the  domain. 

The  constructive  methods  of  this  study,  however,  do  not  seem 
to  require  this  and  it  thus  appears  that  the  earlier  results 

/ 

have  been  strengthened  as  well  as  put  in  constructive  form. 

As  regards  the  analytic  operator  approach  [5, 6, 7, 8]  the 
following  comparative  remarks  are  appropriate.  The  system 
is  assumed  to  be  differentiable  with  derivatives  used  in 
modeling  the  u->-x  map.  This  procedure  has  the  following  attributes: 

(i)  The  expansion  is  valid  on  an  input  set  ||u||  <_  k. 

(ii)  Computing  of  derivatives  of  high  order  is  necessary 
and  f must  be  known  to  a comparable  accuracy. 

(iii)  A family  of  nonlinear  state  equations  with  a linear 
state  -*■  output  map  realizes  the  power  series 
expansion . 

(iv)  No  input-output  information  is  utilized  in  the  expansion. 
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In  the  same  spirit  the  technique  of  sections  3,4  has  the 
following  characteristics: 

( i * ) The  expansion  is  valid  on  a compact  set. 

( i i 1 ) f need  only  be  known  to  he  continuous. 

( i i i ' ) A family  of  linear  state  equations  with  a 

nonlinear  state-output  map  realizes  the  poly- 
nonic  expansion. 

(iv‘ ) Only  input-output  information  is  utilized  in 
the  expansion. 

The  complexity  of  working  with  compact  sets  is 
offset  by  the  computation  of  derivatives,  thus  attributes  (i) 
and  (ii)  are  computationally  on  a par  with  (i')  and  (ii'). 
Concerning  (iii)  and  (iii')  the  merits  of  shifting  the 
nonlinear  behavior  to  the  output  constraint  can  be  judged 
only  in  light  of  a specific  application.  Attributes  (iv) 
and  (iv')  serve  to  crystalize  the  comparison.  If  the  system 
is  precisely  known  then  the  power  series  expansion  methodology 
seems  to  have  the  advantage,  although  one  might  question 
expanding  at  all  in  this  case.  If  the  system  is  unknown  then 
the  methodology  of  this  study  can  be  utilized  to  mathematically 
model  the  system  using  external  measurements. 

Consider  now  the  question  of  convergence  rate.  In  the 
power  series  methodology  convergence  properties  parallel  those 
of  the  power  series  on  the  real  line.  Similarly  the  Bernstein 
system  of  theorem  (4)  is  a linear  operator  composed  with  a 
memoryless  Bernstein  map  and  as  such  convergence  properties 
of  the  Bernstein  polynomials  on  R are  inherited  by  the  Bernstein 
system.  Thus  an  accurate  assessment  for  comparative 
convergence  is  obtained  by  looking  at  the  situation  on  the 
real  line. 
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We  consider  then  the  set  [0,1]  c R,  which  satisfies 
both  (i)  and  (i')  as  the  domain  of  interest.  For  the  function 
f on  R let  m(.)  denote  the  modulus  of  continuity  of  f defined 
by 

m(a)  = sup{ | f (x) - f (y) | : 0<x,y<l,  |x-y|<a>. 

For  continuous  f obviously  m(a)  ■*  0 as  a 0.  We  cite  some 
standard  results  which  go  back  to  Jackson  [25],  Vallee-Poussin 
[26]  and  Popoviciu  [27]. 

Here  we  use  b^  to  denote  the  Bernstein  polynomial  of 
order  n. 

(a)  For  each  n 

sup  | f (x) -b  (x) [ < (5/4 ) m (n-1^2 ) 

[0,1]  n 

If  f is  differentiable  and  m^  is  the  modulus  of  continuity 
of  f'  then  we  have  also 

(b)  For  each  n 

sup|f  (x)-b  (x)  | < (3/4)n_1/2m.  (n-1//2) 

[0,1]  n 1 

In  closing  I would  like  to  acknowledge  the  careful 

review  and  constructive  suggestions  of  ( ) 

which  have  materially  improved  the  paper. 
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